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The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). !n no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent temn adjustment. See 37 CFR 1.704(b). 

Status 

1 )S Responsive to connmunication(s) filed on 18 November 2002 . 
2a)S This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 
Disposition of Claims 

4) ^ Claim(s) U7 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) ^ Claim(s) ^6 is/are rejected. 

7) ^ Claim(s) 7 is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) n The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)n accepted or b)\3 objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
1 1 )□ The proposed drawing correction filed on is: a)n approved b)n disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) 0 The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 1 1 9 and 1 20 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)nAII b)n Some*c)n None of: 

1 .□ Certified copies of the priority documents have been received. 

2. n Certified copies of the priority documents have been received in Application No. . 

3. n Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (POT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 19(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 

15) n Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
Attachment(5) 

1 ) ^ NoUce of References Cited (PTO-892) 4) □ Interview Summary (PTO-41 3) Paper No(s). . 

2) CIl Notice of Draftsperson's Patent Drawing Review (PTO-948) 5) □ Notice of Informal Patent Application (PTO-152) 

3) □ Information Disclosure Statement(s) (PTO-1449) Paper No(s) . 6) □ Other: 
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DETAILED ACTION 



Response to Arguments 



1 . In response to the Office Action mailed August 16, 2002, applicant has filed amendment A, 
to amend claims 1 and 3 to add claims 6 and 7. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claims 1-6 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kirksey (US 
Patent No. 5,938,447 in view of Schulz (US Patent No. 6,185,538), in further view of Imai et al 
(US Patent No. 6,285,982), hereinafter referred to as Imai. 

Kirksey discloses a method and system for creating an audio-visual work, which displays 
the text version of the words heard in the audio. 

3. Regarding claim 1, at col. 5, lines 49-51, Kirksey discloses an embodiment of the system 
in which words maybe placed on an audiovisual work so that they are only visible to a viewer 
who uses a special reading device, which reads on "special reproducing method for specially 
reproducing sound by using an information reproducing apparatus for reading out data from a 
recording medium having audio data and video data, a special reproducing method of sound." 

hi the abstract, Kirksey discloses that the system displays the text version of the words 
heard in the audio. However, Kirksey does not specifically disclose the audio data is read out 
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during special reproduction is converted to text via sound recognition. However, speech to text 
conversion of audio data is well known in the art of speech recognition. 

In a similar field of endeavor, Schulz discloses a system for editing digital video and 
audio information, which specifically provides for the recording and reproducing video and 
audio information and the conversion of the audio source information into text via a speech 
recognition module (col. 4, lines 25-33), which reads on "the audio data read out fi'om a 
recording medium during special reproduction is converted into text data by sound recognition." 
Schulz teaches that the system is advantageous in obtaining recognized text of different voices 
(col. 3, lines 15-23) and foreign languages (col. 4, line 58 continuing to col. 6, line 6). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system Kirksey to implement speech recognition of the audio information as taught 
by Schulz, for the purpose of obtaining the corresponding text of foreign language audio, as 
suggested by Schulz. 

Kirksey does not specifically teach implementation of audio data read out firom a 
recording medium during n-speed reproducing, wherein n is a positive number greater than 1. 
However, implementation data read out fi*om a recording medium during of n-speed reproducing, 
where n is a positive number greater than 1 was well knovm in the art. 

In a similar field of endeavor, Imai teaches a sound decompressing apparatus providing 
improved sound quality during special reproducing, such as forward search reproducing and 
reverse search reproducing. At col. 3, lines 17-60, Imai teaches forward search reproducing and 
describes the implementation of quadruple-speed search reproducing. Imai teaches the system is 
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applicable in a decompressing apparatus for use in a video camera or telephone environment 
(col. 1, lines 8-10). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Kirksey to implement n-speed reproducing, wherein n is a positive 
number greater than 1, as taught by Imai, for the purpose of providing for improved sound 
quality during special reproduction of audio and video data. 

Additionally, at col. 5, lines 56-65, Kirksey discloses the words corresponding to the 
audio are displayed as an integral part of and superimposed on the pictorial scene of the work, 
which reads on "and the characters representing text data are displayed, being overlapped with 
special reproduced images." 

Regarding claim 2, Kirksey, Imai, and Schulz teach everything as claimed in claim 1. 
Additionally, at col. 9, lines 31-37, Kirksey discloses altering the soimd reproduction for altering 
the display time of corresponding text, which reads on "contents of sounds for n-seconds 
recorded on the recording medium are displayed for one second." 

Regarding claim 3, at col. 5, lines 49-51, Kirksey discloses an embodiment of the system 
in which words maybe placed on an audiovisual work so that they are only visible to a viewer 
who uses a special reading device, which reads on "special reproducing apparatus for reading out 
data from a recording medium having audio data and video data." 

hi the abstract, Kirksey discloses that the system displays the text version of the words 
heard in the audio. However, Kirksey does not specifically disclose the audio data is read out 
during special reproduction is converted to text via sound recognition. However, speech to text 
conversion of audio data is well known in the art of speech recognition. 
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In a similar field of endeavor, Schulz discloses a system for editing digital video and 
audio information, which specifically provides for the recording and reproducing video and 
audio information and the conversion of the audio source information into text via a speech 
recognition module (col. 4, lines 25-33), which reads on "the audio data read out fi-om a 
recording medium during special reproduction is converted into text data by sound recognition " 
Schulz teaches that the system is advantageous in obtaining recognized text of different voices 
(col. 3, lines 15-23) and foreign languages (col. 4, line 58 continuing to col. 6, line 6). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system Kirksey to implement speech recognition of the audio information as taught 
by Schulz, for the purpose of obtaining the corresponding text of foreign language audio, as 
suggested by Schulz. 

Kirksey does not specifically teach implementation of audio data read out from a 
recording medium during n-speed reproducing, wherein n is a positive number greater than 1 . 
However, implementation data read out fi-om a recording medium during of n-speed reproducing, 
where n is a positive number greater than 1 was well known in the art. 

hi a similar field of endeavor, Imai teaches a sound decompressing apparatus providing 
improved sound quality during special reproducing, such as forward search reproducing and 
reverse search reproducing. At col. 3, lines 17-60, Imai teaches forward search reproducing and 
describes the implementation of quadruple-speed search reproducing. Imai teaches the system is 
applicable in a decompressing apparatus for use in a video camera or telephone environment 
(col. 1, lines 8-10). 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Kirksey to implement n-speed reproducing, wherein n is a positive 
number greater than 1, as taught by hnai, for the purpose of providing for improved sound 
quality during special reproduction of audio and video data. 

Additionally, at col. 5, lines 56-65, Kirksey discloses the words corresponding to the 
audio are displayed as an integral part of and superimposed on the pictorial scene of the work, 
which reads on "and the characters representing text data are displayed, being overlapped with 
special reproduced images displayed in a display device" 

Regarding claim 4, Kirksey, Imai, and Schulz teach everything as claimed in claim 3. 
Additionally, at col. 5, lines 49-51, Kirksey discloses an embodiment of the system in which 
words maybe placed on an audiovisual work so that they are only visible to a viewer who uses a 
special reading device, which reads on "reading means for reading out audio data and video data 
from a recording medium." 

At col. 5, Unes 56-65, Kirksey discloses the words corresponding to the audio are 
displayed as an integral part of and superimposed on the pictorial scene of the work, which reads 
on "display means for displaying reproduced images based on video data on the display device." 

In the abstract, Kirksey discloses that the system displays the text version of the words 
heard in the audio. However, Kirksey does not specifically disclose the audio data is read out 
during special reproduction is converted to text via sound recognition. However, speech to text 
conversion of audio data is well known in the art of speech recognition. 

Schulz discloses a system for editing digital video and audio information, which 
specifically provides for the recording and reproducing video and audio information and the 
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conversion of the audio source information into text via a speech recognition module (col. 4, 
lines 25-33), which reads on "the audio data read out from a recording medium during special 
reproduction is converted into text data by sound recognition." Schulz teaches that the system is 
advantageous in obtaining recognized text of different voices (col. 3, lines 15-23) and foreign 
languages (col. 4, line 58 continuing to col. 6, line 6). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system Kirksey to implement speech recognition of the audio information as taught 
by Schulz, for the purpose of obtaining the corresponding text of foreign language audio, as 
suggested by Schulz. 

At col. 5, lines 56-65, Kirksey discloses the words corresponding to the audio are 
displayed as an integral part of and superimposed on the pictorial scene of the work, which reads 
on "and the characters representing text data are displayed, being overlapped with special 
reproduced images displayed in a display device" 

At col. 8, lines 25-39, Kirksey discloses the apparatus for creating the audiovisual work 
which includes an operator station, video text generator, audiovisual input means, and optical 
manipulator for combining text and audiovisual work, which reads on "control means for 
instructing reading means, display means and conversion means to perform special 
reproduction." 

Regarding claim 5, Kirksey, Imai, and Schulz teach everything as claimed in claim 3. 
Additionally, at col. 9, lines 31-37, Kirksey discloses altering the sound reproduction for altering 
the display time of corresponding text, which reads on "contents of sounds for n-seconds 
recorded on the recording medium are displayed for one second." 
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Regarding claim 6, at col. 5, lines 49-51, Kirksey discloses an embodiment of the system 
in which words maybe placed on an audiovisual work so that they are only visible to a viewer 
who uses a special reading device, which reads on "special reproducing apparatus for reading out 
data from a recording medium having audio data and video data." 

In the abstract, Kirksey discloses that the system displays the text version of the words 
heard in the audio. However, Kirksey does not specifically disclose the audio data is read out 
during special reproduction is converted to text via sound recognition. However, speech to text 
conversion of audio data is well known in the art of speech recognition. 

In a similar field of endeavor, Schulz discloses a system for editing digital video and 
audio information, which specifically provides for the recording and reproducing video and 
audio information and the conversion of the audio source information into text via a speech 
recognition module (col. 4, lines 25-33), which reads on "the audio data read out from a 
recording medium during special reproduction is converted into text data by sound recognition." 
Schulz teaches that the system is advantageous in obtaining recognized text of different voices 
(col. 3, lines 15-23) and foreign languages (col. 4, line 58 continuing to col. 6, line 6). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system Kirksey to implement speech recognition of the audio information as taught 
by Schulz, for the purpose of obtaining the corresponding text of foreign language audio, as 
suggested by Schulz. 

Kirksey does not specifically teach implementation of audio data read out from a 
recording medium during n-speed reproducing, wherein n is a positive number greater than 1 or a 
system controller for controlling a reproducing speed of the recording medium. However, 
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implementation of a system controller for controlling a reproducing speed of a recording medium 
and data read out from a recording medium during of n-speed reproducing, where n is a positive 
mmiber greater than 1, was well known in the art. 

In a similar field of endeavor, Imai teaches a sound decompressing apparatus providing 
improved sound quality during special reproducing, such as forward search reproducing and 
reverse search reproducing. At col. 2, lines 41-42, Imai teaches implementation of an input 
determination section, which detects an indication of special reproducing of sounds. At col. 3, 
lines 17-60, Imai teaches forward search reproducing and describes the implementation of 
quadruple-speed search reproducing. Imai teaches the system is applicable in a decompressing 
apparatus for use in a video camera or telephone environment (col. 1, lines 8-10). 

Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Kirksey to implement n-speed reproducing, wherein n is a positive 
number greater than 1, as taught by Imai, for the purpose of providing for improved sound 
quality during special reproduction of audio and video data. 

Additionally, at col. 5, lines 56-65, Kirksey discloses the words corresponding to the 
audio are displayed as an integral part of and superimposed on the pictorial scene of the work, 
which reads on "and the characters representing text data are displayed, being overlapped with 
special reproduced images displayed in a display device" 

Kirksey does not specifically teach MPEG audio and video decoders for decoding audio 
data and video data. However, implementation of MPEG decoders was well known in the art. 

Imai teaches implementation of MPEG decoders at col. 4, line 60 continuing to col. 5, 

line 15. 
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Therefore, it would have been obvious to one of ordinary skill at the time of the invention 
to modify the system of Kirksey to implement MPEG decoding as taught by Imai, for the 
purpose of displaying text or pertinent words with the images of a perceptually encoded audio- 
visual work. 



Allowable Subject Matter 
4. Claim 7 is objected to as being dependent upon a rejected base claim, but would be 
allowable if revmtten in independent form including all of the limitations of the base claim and 
any intervening claims. 

The following is a statement of reasons for the indication of allowable subject matter: 
The prior art of record fails to specifically teach or suggest the combination of an information 
reproducing apparatus for reading out data from a recording medium having audio data and 
video data, comprising, inter alia, a data analysis processing unit for analyzing the audio data 
according to speed change information from the system controller and for improving the 
accuracy of sound recognition by suppressing unnecessary noise; a data table for registering the 
text data and the corresponding audio data; and a data conversion processing unit for integrating 
the timing of the audio data from the data analysis processing unit with the timing of the audio 
data from the data table, and searching audio data from the data table nearest to the audio data 
from the data analysis processing unit by comparing each audio data and receiving the text data 
corresponding to the audio data from the data table. 
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Response to Arguments 



Applicant's arguments with respect to claims 1-6 have been considered but are moot in 



view of the new ground(s) of rejection. 



Conclusion 



Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated fi-om the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS fi-om the date of this 
final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Angela A. Armstrong whose telephone number is 703-308-6258. 
The examiner can normally be reached on Monday-Thursday 7:30-5:00 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on (703) 305-4379. The fax phone numbers 
for the organization where this application or proceeding is assigned are 703-872-9314 for 
regular communications and 703-872-9314 for After Final communications. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is 703-306-0377. 



Angela A. Armstrong 

Examiner 

Art Unit 2654 



AAA 

February 7, 2003 



MARSHA D. BANKS-HAROLD 
SUPERVISORY PATENT EXAMINER 
TECHNOLOGY CENTER 2600 ^ 



